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Maximizing throughput for heterogeneous parallel server queues has received quite a bit of attention from the research 
community and the stability region for such systems is well understood. However, many real-world systems have periods 
where they are temporarily overloaded. Under such scenarios, the unstable queues often starve limited resources. This 
work examines what happens during periods of temporary overload. Specifically, we look at how to fairly distribute stress. 
We explore the dynamics of the queue workloads under the Max Weight scheduling policy during long periods of stress 
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and discuss how to tune this policy in order to achieve a target fairness ratio across these workloads. 



<vj : 1. Introduction 

£C) , Queueing systems are generally designed with sufficient allocation of resources to ensure that the system 

(N ■ 

is stable. Subsequently, a large body of research in queueing has focused on characterizing the stability 
region and on evaluating and optimizing performance when the queues are operated within this region. 
However, in reality, it is inevitable that a system will repeatedly enter long periods of overload, either due to 
an unpredictable increase in load or because some service resources may become unavailable/breakdown. 
^ ■ In such periods, which may last for a fairly long duration of time, the system may have more load than 

it can handle. Hence, it is natural to want to understand what happens during these periods of temporary 
instability. 

Some examples of real systems which experience periods of instability can be found in internet com- 
munication networks, hospitals, and call centers. Consider systems where traffic is bursty. For instance, in 
communications networks, with the release of a new online game, the system may be over-stressed as many 
people attempt to simultaneously enter the virtual world. At a hospital, there may be a surge in demand for 
the limited hospital resources during a catastrophic event or viral outbreak. In these cases, the system load 
may increase to potentially unstable levels. A separate scenario of temporary overload may occur when 
resources are lost. In call centers, a power outage may effectively remove a pool of servers. Consequently, 
while the system load may remain constant, the available service resources have been reduced, stressing the 
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system. 

In long periods of overload, it is inevitable that the system backlog will grow significantly, so the question 
of performance optimization becomes moot. However, it is desirable to share the stressed resources in a. fair 
manner among the different customers. In this paper, we study fair resource allocation in multiclass parallel 
server queues during long periods of overload or temporary instability. 

How does one define fairness in an overloaded system? Consider a system which is overloaded for a very 
long time window. During this time window, the system is essentially unstable, so that the total backlog 
grows without bound. However, it is plausible that some customer classes will enjoy a greater allocation of 
the stressed resources, enough such that the system will appear stable to these classes. This is unfair. Our 
novel notion of fairness requires that the backlog of the different customer classes will grow large according 
to a predetermined proportion, thereby proportionately distributing stress across customer classes. This is 
the same as requiring that the backlog vector will grow along a prespecified direction. 

Working with this notion of fairness, our ultimate goal is to determine how to operate the overloaded 
system such that the total backlog is minimized subject to a fairness constraint. Our main result is that 
the MaxWeight scheduling algorithm, with carefully selected weight parameters, will achieve this goal 
asymptotically, as the duration of the overloaded period grows large. The MaxWeight policy selects, at 
each time point, a service configuration whic h maximizes the aggregate service rate weighted by the 



queue backlogs and a controllable weight vector (ITassiulas and Ephremides 



1992, 



Mande 



2004). MaxWeight has been shown to be throug 



Tassiulas and Bhattacharyal (I2000h . 



l put maximizing (see for example 



McKeown et al. 



baum and Stolvar 



Tassiulas 



1995). 



Armony and Bambosl (12003b ). That is, as long 



(119991) . 

as the system is stabilizable, it will be stable under MaxWeight. 

Our analysis first shows that, under MaxWeight with arbitrary fixed weights, the backlog in an overloaded 
system will grow to infinity according to a well defined direction. We then proceed to show that this direction 
can be turned to any feasible fairness proportion by carefully selecting the weight parameters of MaxWeight. 
Finally, we establish that, in the limit, MaxWeight will minimize the total backlog among all algorithms 
that obtain this fairness direction. 



Th e approach we take in o ur analysis is a trace-based approach (ILoynes 



1963 



Armony and Bambos 



2003 



Ross and Bambos 



20 Q9) which analyzes individual traces of customers' arrival times and workload 
requests. To show that the backlog grows along a specific direction, we use direct geometric arguments that 
examine the dynamics of an actual trajectory of the backlogs and how it evolves over time. In particular, 
our statistical assumptions are extremely mild, and only require that the workload entering the system has a 
well defined long time average. 
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The rest of the paper is organized as follows: We conclude this introduction by surveying some closely 
related literature. In Section|2]we formally introduce our queueing model and the notion of fairness which 
we study. In Section [3] we show the existence of a unique limit for the queue backlogs when the system is 
unstable. In Section [4] we discuss how to control the backlog to achieve our desired fairness criterion. In 
Section [5] we show some numerical results to demonstrate the performance of our proposed algorithm in 
practice. Finally, we conclude in Section [6] 
Related Literature 



Stolyan (12004ft analyzes the same type of parallel server queueing systems, under the assumption that the 
system is in heavy-traffic. That is, the system is stable but operates close to the boundary of the stability 
region. For such systems, the author shows that under Max Weight and a complete resource pooling con- 
dition, the backlog vector will experience a state-space collapse, which implies that it will asymptotically 
follow a well defined direction. The author also shows that MaxWeight minimizes the workload, where 
the latter is defined as the total backlog weighted by the above direction. These res ults are s imilar to our 
convergence and backlog minimization results, but since the system considered in IStolyar! (12004b is not 



overloaded, much stronger assumptions are required there-s uch as the Markov property and the complete 
resource pooling condition. iMandelbaum and Stolyar! (120041) generalizes these results for convex holding 
cost functions and a corresponding gener alized c/i rule. 



More recently, Shah and Wischik in (IShah and Wischik 



201 lb study the asymptotic behavior of fluid 



models in overload under MaxWeight and other policies. Analogously to our result, they show that as time 
grows large, th e fluid vector will approac h a well defined direction. While the network structure and the set 
of policies that 



)proac 
(BOH 



Shah and Wischik! (120111) studies are more general than our setting, that paper focuses on 
characterizing the asymptotic direction of the backlog of the overloaded system. Our paper, on the other 
hand, focuses on controlling this direction to satisfy a fairness constraint a nd on minimizing t he ba cklog 



Shah and Wischik! (1201 II) uses 



subject to this constraint. Methodologically the two papers are also different; 
Lyapunov functions to prove convergence of the continuous fluid trajectory, while our analysis directly 
examines the dynamics of the que ueing trajectory. 



Also in the networked setting, iGeorgiadis and Tassiulas 



where transmissions are scheduled in a distributed manner. Specifical 
show that a policy analogous to the Adaptive Back Pressure policy of 



(12006b consider overloaded sensor networks 



Georgiadis and Tassiulas 



(2006) 



Tassiulas! (11995b (reference [20] in 



Tassiulas' paper) obtains, in the limit, a backlog vector which i s the so-called "most balanced" among all 



feasible limits, in overload. Similar to 



Shah and Wischik! (1201 lb . the authors consider a fluid model rather 



than the direct queueing trajectory dynamics considered in this work. 
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Our concept of fairness in this paper is also somewhat unusual. Two commonly used fairness criteria are 
Max-Min and Proportional Fairness. A system is considered Max-Min fair if the utility of the user with 
the minimum utility is maximized. On the other hand, a system is considered to be proportionally fair if 
the amount of service resources a user is allocated corresponds to the proportion of anticipated resource 
consumption required by the user. These two notions of fairness can be tied together under the description 



2000). There has been a substantial amount of 



of a-fairness with different values of a (IMo and Walrand 
work in the development of scheduling policies which ensure s o me fairness criteria (see 



(2000), 



(2006), 



Kellv and Wil 



Neelyj<l2006j), 



iamsl(2004). 



Bonald et al 



Ervilmaz and Srikantl ( 20051) . 



(200 



6), 



Neelv et al. 



(2005), 



Mo and Walrand 



Ervilmaz and Srikant 



Massouhd (|2007|) and related works). A common thread in those 



papers is an assumption of stability, whereas we consider fairness during periods of temporary instability. 
We define fairness by a set of ratios which specifies the desired proportion of the aggregate backlog each 
queue contributes. In Section 14741 we elaborate more on the connection between the traditional notions of 
fairness and the one used here. 
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Perry and Whittl (|200' 



201 1|) consider how to deal with unexpected overload. They consider overload in 
the setting of two initially separated service systems which share resources when one becomes overloaded. 
Using a fluid model, they consider how to share resources across the two systems in order to maintain a 
constant ratio between the two queues. Our setting is quite different as there is a single system with multiple 
parallel queues. However, we share a similar control goal of maintaining a constant ratio between queues, 
of which we may have more than two. 

2. The Queueing Model 

We consider a queueing system with Q queues and N service vectors. New jobs arrive to the system and 
are queued up to be served. The system administrator dynamically selects which service configuration to 
implement for service of available jobs in the queue. We consider how to make this selection in a 'fair' 
manner, where we will be more precise as to what we mean by fair in the coming discussion. 

More formally, we consider a queueing system with Q parallel queues, indexed by q £ Q = {1, 2, . . . , Q}. 
Time is discrete and indexed by t € Zj. Let A q {t) be the number of jobs arriving to queue q in time slot t. 
We assume that < A q (t) < A q for some arbitrarily large A q > 0. For each q G Q, we assume that 



lim E -°^ (s) =^€(0,oo) 

t— >oo t 



is well-defined, positive, and finite. The arrival vector in time slot t is thus 



(2.1) 



A(t) = (A!(t), A a (t), • • ., A q (t), Aq (t)) 



(2.2) 
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with corresponding long-term traffic load vector: 

P=(PuP2,---,Pq,---,PQ) (2-3) 

Arriving jobs are buffered in their respective queues and are served in a first-come-first-served (FCFS) 
manner within each queue. 

In each time slot, a service vector S € S = {Si, S 2 , ■ ■ ■ , S n , . . . , S N } is selected to be used. Each service 
vector is a Q-dimensional vector: 

S = (S 1 ,S 2 ,...,S q ,...,S Q ) (2.4) 

where S q > is the number of jobs removed from queue q in a single time slot when service configuration 
S is used. 

The workload in queue q at time t is denoted by X q (t) with corresponding workload vector: 

X(t) = (X^t)^^), . . .,X q (t), . . .,X Q (t)) (2.5) 

This corresponds to the number of jobs in each queue in time-slot t. 

Given workload vector X(t) and service configuration S(t), the number of jobs that are served and depart 
from queue q is: 

D q (t)=mm{S q (t),X q (t)} (2.6) 

where the minimum accounts for the fact that jobs can only be serviced if they are already waiting in the 
queue. Hence, if D q (t) = X g (t) < S q (t), there is some idle service provided by service vector S(t) due to 
the lack of available jobs to be processed. The workload vector evolves as: 

X(t + l)=X(t) + A(t)-D(t) (2.7) 

Assuming the queue begins empty at time t = 0, then the workload vector X(t) is given by: 

t-i t-i 

X(i) = $>( S )-^L>( S ) (2.8) 

s=0 s=0 

Applications We note that many applications of interest can be modeled in this way. For example, in 
communication networks, the backlogs correspond to packets waiting to be transmitted on various wired or 
wireless links while the service vectors correspond to various packet switch configurations. In call centers, 
the backlogs correspond to the number of customers of various classes waiting to be served while the service 
vectors correspond to specific allocations of staff with differing skills to each customer class. 
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2.1. (In)Stability Region 

Loosely speaking, we consider a system to be rate stable if the average job departure rate is equal to the 
average arrival rate. We define the stability region of a system, V, such that if p G V, then there exists some 
policy which guarantees for each queue, q, that: 

lim _____ = o (2.9) 

t-s-oo t 

The stability region can be characterized as: 

{N N 
peR+: p<^2 ctiSi for some a, > 0, fi, £ S such that = 1 > 

i=l i=l J 

= < p £ ffi^ : (p, Av) < max (S 1 , Av) for every v € J- (2. 10) 



as defined in lRoss and Bambosl (120091) . Hence, any system load which is dominated by a convex combina- 
tion of service vectors is stablizable. Furthermore, stability is ensured by using this convex combination. 

When the system load is outside of the stability region, then the system is unstable. Hence, if p g" V, then 
there does not exist any policy which guarantees that: 



and with probability 1, 



for some q (see 



Armonv and Bambos 



l im _____ = (2.11) 

t— foo t 



l im ____l> (2.12) 

t— s-oo t 



(120031) ). We refer to this as the instability region. Consider the fol- 



lowing simple example of the stability and instability regions. 

Example IConsider an example with two queues (Q = 2) and three (N = 3) service vectors: 

^=(i)'^=(i 1 5 )'^=(!) (2 - i3) 

The stability region, V, is given by the convex hull of Si, S2, S3 (and their projections onto the axes). Note 
that 5*3 is a non-essential service vector, since it is dominated by a convex combination of S± and S 2 and its 
removal would not change V. Any load vector p within the shaded region in Figure\J}is stabilizable; outside 
the region, is not. Hence, p is stabilizable while p' is not. 

The focus of this work is the understand and control the dynamics of systems which are temporarily 
overloaded over a long time horizon. To do this, we approximate the dynamics of a temporarily unstable 
system with a system which is permanently unstable (p £ V). When the period of overload is long enough, 
the dynamics of the two systems will be similar. Hence, our analysis focuses on the dynamics of unstable 
systems. 
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Figure 1 An example of the stability region for a 2-queue queueing system. 

2.2. Fairness 

The goal of this work is to determine a service discipline which allows us to fairly serve queues when the 
system is temporarily overloaded (p 4. V). There are many different definitions of fairness (see for instance 



Mazumdar et al 



(1991D , 



Kelly et al 



1998), 



Mo and Walrandl (I2Q00Q '). In this paper, we focus on a notion of 



fairness where the workloads grow according to a fixed proportion. More formally, we assume we are given 
a set of ratios 6 q > 0, Y^ q 9q = 1- These ratios specify the proportion of the aggregate workload which each 
queue contributes. Whenever p V, the goal is to control the workload such that for large t: 

x q (t) 



More precisely, we want to control X(t) such that: 



O qi Mq € Q 



where rj satisfies our fairness criterion: 



lim 

t— f oo 



X(t) 



,Vz 



(2.14) 



(2.15) 



(2.16) 



9 defines a direction which we want the backlogs to grow; rj includes the scale factor to specify how quickly 
they grow. 

There may be many policies which achieve this fairness criterion and our goal is to find the policy which 
achieves it with the minimal workload. Let X(t) correspond to the workload at time t given service vector 
S(t) is used in time slot t. Our goal is to find S(t) such that for large t: 

x q (t) 



lim 



(2.17) 
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x' (t) 

Furthermore, if there exists X'(t) which uses S'(t) in time slot t and lim^oo „ q , , , = 6„, Vg € Q, then 

lim — — < lim — — (2.18) 

t— >oo t t— >oo £ 

We will go into more detail about this fairness criterion in Section |4] Further, we will show that this 
definition can be generalized to other f airness definitions. Our proposal is to use Max Weight scheduling 



policies to achieve our fairness criterion 



Armony and Bambosl (|2003[) . 



Ross and Bambosl (2009). 



2.3. The MaxWeight Scheduling Policy 

The stability region guarantees the existence of a stabilizing policy. We now briefly review a family of 
stabilizing policies, which we refer to as MaxWeight Scheduling. This is the special case of Projective 
Cone Scheduling (PCS) when projection matrices are diagonal. This family of policies is characterized by 
service cones wherein the set of workloads X(t) under which service vector Si is used forms a cone in 
the workload-space. We focus on this family of policies because they work 'well', i.e. are stabilizing when 
possible, they are simple to implement, and as we will see later, they are optimal in the sense that they 
obtain the minimum backlog (12.181 ) subject to the fairness criterion (12. 17b - 

Let B be a symmetric, positive definite matrix with non-positive off-diagonal elements. Let X = X(t) 
be the workload at time t. Then, the PCS algorithm selects service vector S*: 

S* G S max (X) = argmax(S,BX) = argmaxX T BS (2.19) 

ses ses 



It is shown in 



Ross and Bambos 



(|2009|) that the PCS policy is rate stable for any p£V. This policy is also 
desirable from an implementation standpoint as it only requires current information (workload state) and 
does not require knowledge of the system load p. 

We define the service cone Cj as the set of workload vectors, X, such that service vector S t is used under 
the algorithm defined by positive definite matrix B; i.e.: 

C l = C l (B) = {X\S l €argmax(S,BX)} (2.20) 

SdzS 

For the rest of the discussion, we will suppress the dependence of the service cones on the matrix B. 

Throughout this work, we will focus on the case where the matrix B is a diagonal matrix, A (and positive- 
definite, hence, all its diagonal elements are positive). This specifies the set of algorithms to MaxWeight 
scheduling algorithms, which have been studied extensively in the past. 

Assumption 2.1B = A is a diagonal, positive definite matrix, i.e. A. qq > and A. qq i = 0, Vq ^ q' 
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While we are ultimately interested in the behavior of this queueing system when it is temporarily over- 
loaded, our focus on Max Weight scheduling policies ensures that the system is stabilized when possible. 
We will examine the asymptotic behavior of this class of policies and its implications in term of our fair- 
ness criterion. We will see that this family of algorithms allows us to satisfy certain fairness criterion by 
manipulating the A matrix. Furthermore, we will see in Section l4~2l that the Max Weight scheduling poli- 
cies achieves the lowest workload which satisfies our fairness criterion. In order to see this, we must first 
understand how the A matrix affects the asymptotic behavior of our queueing system. 

3. Asymptotic Dynamics in Overload 

Before we consider how to control the workload vector, X(t), we first begin by building an understanding 
of its asymptotic dynamics given diagonal Max Weight matrix A. We already know that if p G V, then the 
Max Weight scheduling policy stabilizes the system and the workload is always finite. On the other hand, 
many real sy stems enter periods of i nstabi lity where the system load is temporarily outside of the stability 



region. From lArmony and Bambosl (120031) . when p^V the workload explodes: X(t) — > oo. However, we 
are interested in finding out how exactly this happens. Is there a finite limit for Hindoo — f 1 ! If so, what is 
it and what does it depend on? This section is devoted to answering these questions. 
Suppose that the system operates in overload, in the sense that p^V, where 

T> = | p eR® : (p,Av) <max(S, Aw) for every v € M Q } , (3.1) 



as defined in lRoss and Bambosl (12009b . We consider the limit defined below: 



tf = limsup /^),A^) (3.2) 

t->oo \ t t 



and select a convergent increasing unbounded subsequence {t c } on which the 'lim sup' is attained^- hence, 

lim = f] (3.3) 



c— >oo f 



and 



Lemma 3.lWe have 



lim /^M ) A^^) = (r l ,Ari)=H. (3.4) 



C->00 \ t r tc 



p^V^V^O (3.5) 

See footnote 12 of lRoss and Bambosl < |2009|) concerning why such a subsequence exists 
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PROOF: See the proof of Proposition 2. 1 in lArmony and Bambosl (120031) . In short, we have that 



x 9 (t) 



p^V => lim sup — - — > for some qeQ 

t— >oo t 



(3.6) 



This in turn implies that: 



r) ^ and, so lim sup (^^-, A—^ ) = (rj, A-q) =H>0. 

t— >oo \ t t 



(3.7) 



Thi s result follows directly from the stability results of lArmony and Bambosl (120031) . iRoss and Bambos 



(120091) which say that when p € V the time-scaled backlog goes to as t— >oo. When the system is not 



stable, the opposite occurs and there exists a non-zero sub-limit. Our key result in this section is that r\ is 

X ( t ") 

the unique limit of — j- 1 over all possible arrival traces. 



Theorem 3.1When p^V, we have 



x(t) 

lim — — = rj^0. 



(3.8) 



t->oo t 

That is, the workload explodes on the same non-zero ray i] on any arrival trace. Furthermore, T] is defined 
as the unique solution to the following convex program: 



where 



(r],Ar])= min (rj',Arj') 

jj'e*(p,s) 



S) = {?/ :rf = {p- r) + with r € V} 



(3.9) 



(3.10) 



and V is the stability region given by S. Therefore, r = ^2 SeS ® S S with ^2 SeS ct s < 1 and as > for 
each S ES, where S is the set of service vectors. Equivalently, rj is the unique fixed point which satisfies 
71 = p- Y^ses a s S with Eses a s = l,a s >0 and 



(rj, A.S m ) > A.S k ) Vm such that a m > 



(3.11) 



PROOF: The proof will conclude at the end of Section [3] We will first show that the limit is unique for each 
individual arrival trace. We then extend our analysis to show the limit is the same for all arrival traces with 
identical time-average traffic load, p, which in turn, implies uniqueness over all arrival traces. We begin 
with a number of defi nitions and structu r al pro perties of the defined elements. 



Ross and Bambosl (|2009h on Max Weight Scheduling cone geometry, recall that C s 



From Section V of ] 

{iet Q : (S, Ax) = max s / e5 (S 1 , Ax)} is a cone, and when X(t) G C° s (the interior of C s ) the Max Weight 
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scheduling policy will choose S(t) = S. Moreover, the surrounding cone of any non-zero vector r\ is the 
cone 

C(v)= (J C * ( 3 " 12 > 

Se5*(r,)-5t 

where S* (77) = argmax 565 (S, A 77) is the set of service vec tors of that Max We i ght Sc heduling would select 



Ross and Bambosl (120091) . end of Section IV). 



for backlog 77 and is the set of non-essential ones (see 
Loosely speaking, the non-essential service vectors are the one whose removal will not change the stability 
region. Hence, C{rj) is the union of all cones corresponding to the set of service vectors which can be used 
if X(t) = r). We have 

X(t)eC°(r]) => (5(t),Ar ? ) = max(5,A7 ? ) (3.13) 
where C°(rj) is the interior of C(rj). Define now 

K(rf) = {x£ : x q > max{5 g } for each q with rj q > 0}, (3.14) 

which is the set of backlogs such that no queue q with r) q > can be emptied in a single time slot. Note 
that K{rj) is upward-scalable; indeed, x G K,{rj) implies ax G K,(rj) for any scalar a > 1. Note that when 
X{t) £ £(7?) we have X q (t) > m&x SeS {S q } for all q G Q with r] q > 0, so D q {t) = min{X q (t), S q (t)} = 
S q (t) . Therefore, 

X(t) G K{rj) =^ D q (t) = S q (t) for all q G Q with rj q > 0. (3.15) 

That is, all service capacity allocated at slot t to queue q with rj q > is used; there is no idling in that time 
slot; and the departures from all queues q with r\ q > is exactly equal to the total service provided to that 
queue. Consider now the set 

V(r ) ) = }C(i 1 )f]C (r l ) (3.16) 

and note that it is upward-scalable, that is, x G V{rj) implies ax G V{rj) for any scalar a > 1. Thus, the set 
V(rj) is 'cone-like'. 

The main idea for the proof for the existence of our limit is that excursions away from rj take a very long 
time-so long that the time-average properties we have for arrivals will become active. In particular, there 
will be some time after which all deviations of away from r] will remain in V(r?). To show this, we will 
need to demonstrate certain properties of these excursions. 

3.1. Structural Properties 

We now identify a number of structural properties of 77 and related elements. The proofs of these properties 
can be found in the Appendix. These properties are important to characterizing deviations from 77 and 
showing our main result on the limit of —f 1 . 
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Lemma 3.2For every sequence {t' c } such that t' c < t c and 

X(t)eV( V ) for every X(t) E (t' c ,t c ] (3.17) 

for every c, we have 

During the interval (t' c , t c ] , X(t) € /C(r?) , which means any service vector used in this interval will maximize 
the inner product: (S(t), A77). Furthermore, by definition of /C(r/), there is no idling for all q such that 
rj q > 0. This result simply accounts for the new jobs which arrive and the jobs which are serviced over the 
subset of queues with rj q > 0. 

Lemma 3.3For any increasing unbounded time sequences {t n } and {t' n }, we have 



*n-l 

lim = X € (0, 1] lim t^p^Z = p (3.19) 



t n -t> _ Et^A(t) 



tn n— >oo £_ — t 



Therefore we can define the time-average workload over sub-intervals which grow linearly in time. 
Lemma 3AFor any increasing unbounded subsequence {t m } with lim™-^ x ^ m ^ = p> we have 

(//, Ar/) > (p, Ar/) - max (S, Ar/) (3.20) 
Lemma 3.5For any increasing unbounded subsequence {t m } with linim-^oo x j* m ) = ^ t we have 

(M, Ar/) > (n, Ar/) =>- // = 77 (3.21) 
Lemma 3.6For every e £ (0,1) we have 

- {p, Ar?) - max (5, Ar/) 1 -i- + (r/, Ar/) -?- > (r/, Ar/) (3.22) 

o£6 J 1 — 6 1 — 6 

3.2. Uniqueness of limit lim^ on an individual arrival trace 

In order to prove the uniqueness of the limit on a given arrival trace, we need one more definition and one 
more property. We shall begin by assuming that there is some other convergent subsequence {X(t a )} such 

X (t ) X (t ) 

that lim a _ ! . 0O y t a> = ip ^ 77. Note that tp q < 00 for all q. This is easy to see since ip q = lim a _ s . 0o g t — < 



lim^oo Aq j; ta ^ = p q < 00. We will eventually show that this subsequence does not exist. 
Recall that we have subsequence {t c } which achieves the 'lim sup' in (13.21 ): 

l im = rj (3.23) 
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Define 

s c = max{t a : t a < t c ] < t c (3.24) 

Since s c is a subsequence of t a , lim^oo x ^ Sc ^> = ip. This is a subsequence of the deviations away from 77. 
Given this definition of {s c }, we can show the following property: 

Lemma 3.7We have that 

liminf^— ^ = e€(0,l) (3.25) 

i.e. s c grows nearly linearly with t c . The proof of this Lemma can be found in the Appendix. 
We are now prepared to show the uniqueness of the limit on an individual arrival trace. That is: 

Proposition 3.lThere is no subsequence {t a } with lim^oo x j ta ^ =ip 7^ 77. Therefore, 

lim = n (3.26) 

t^oo t 

PROOF: Arguing by contradiction, assume that there is some other convergent subsequence {X(t a )} such 
that lim^oo EMsl = ^ ^ -q_ We shall show that this is impossible. As stated before, note that ip q < 00 for all 
q. Select now a subsequence of {t c } on which the 'liminf is attained in (I3.25I ). but keep the same indexing 
c of the original one for notational simplicity, hence, 

lim ^— ^ = e€ (0,1). (3.27) 

c-s-oo E 



tc 

c— J-oo c 



s c 1— e' 



by Lemma [3771 hence the length of time of the deviations grows linearly with t c . Therefore, lim 
7^— and lim r _ 

Applying Lemmas [3721 and 1331 with {t' c } = {s c }, dividing by t c — s c and letting c— >oo, we get 

li m / X (Q ~ X(s c ) \ = _ m ^ (3 2g) 

c^oo \ t — s r / ses 



Then, we can write 



(ip, Ar/) = lim ( — ^— Ar/ 



s 

X{t c )-X{s c ) t c -s c X(t c ) t c 
lim ( 1 , Ar/ 

c >-oo \ % r S r S r l c S c 

(p, Ar/) - max (S, Ar/) + (r/, Ar/) 



1-e WI " 1-e 
>(r/,Ar/) (3.29) 

The last equality is due to Lemma [331 Therefore, (ip, Ar/) > (r/, Ar/), which implies tp = rj from Lemma 
13.51 But this contradicts the assumption that ip ^ 77. This establishes the sought after contradiction. So for 
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each individual arrival trace, there exists a unique limit lim^^ —f 1 = 77, which concludes the proof of the 
proposition. Moreover, since lim t _ i . 00 = 77 this implies that there exists t < 00 such that X(t) is in 
V(t?) for all t>t . M 
The main argument is essentially that no other sublimit can get very far from t c and any excursion away 
from 77 is small. Therefore at large t, all subsequences are close enough to 77 to be in one of the neighboring 
cones, i.e. in V(rj). We have now shown that there exists a unique limit, 77, such that on a given arrival trace: 
lim^oo = 77. To complete the proof of Theorem l3.ll it remains to show that the limit, 77, is independent 
of the particular arrival trace. To do this, we turn to characterizing 77. 

3.3. Characterizing the limit 77 

The purpose of this section is to characterize the limit 77 in terms of p and service vectors S to establish the 
independence of 77 on the individual arrival trace. Knowing that lim t _ > . clo — f 1 = 77, we now turn to identifying 
a couple of the characteristic properties of 77. The proofs of these Lemmas can be found in the Appendix. 



Lemma 3.8Every limit is a fixed point. That is, 

*M_r. ^. c r ( 3. 30) 



77 = lim — — = p - y a m S, 

t— ► oo 7; L z — • 

m— 1 

for some a m > 0, ^ m a m = 1. Furthermore, a rn > implies that 77 G Cg m . 



Note that because a m > implies that 77 € C Sm , we know that 77 is in the intersection of all cones with 
a m > 0. Hence, if there are multiple a m > 0, then 77 is on the boarder of all cones with a m > 0. Because 77 
is a fixed point: 

Lemma 3.9The following equality holds: 

(77, A77) = (p, A77) — max (S, A77) (3.31) 

We are now in position to show that 77 depends only on the load vector, p, and available service vectors, 
S. That is, 77 is independent of the particular arrival trace and is the solution of a simple convex program. 

Proposition 3.2The vector 77 = lim^oo — ^ is the unique minimizer of 

(77, A77) = min (T]',Ari') (3.32) 

r;'G*(p,S) 

where 

S) = {77' : ?/ = (p - r) + with reV} (3.33) 

and V is the stability region given by S. Therefore, r = X^ses a sS with ^2 SeS c*s < 1 and as > Ofor each 
S € 5, where S is the set of service vectors. 



15 



PROOF: First we show that 77 is indeed the solution to (13.32I ). Then we show there is only one solution in 
order to conclude that 77 is unique. 

From Lemma [3T8l we have that 77 G ^>(p,S). Arbitrarily choose any vector 

fj= (p-^2a s S) , with ^a s < 1, and a s >0,SeS. (3.34) 

ses ses 

Projecting on A77 we get 



(77, Ar/) = ( [p-^a s S* 

\ ses 

> (p-^a s S,Ar] 
\ ses I 
= (p,A v )-J2»s(S,A v ) 




ses 

> (p, A77) - max (S, A77) = (77, A? ? ) (3.35) 

The first inequality comes from the fact that A. qq > and 77^ > 0. The last equality comes from Lemma [3791 
Therefore, (77, A77) > (77, A77). This implies (recalling that A is positive-definite) that 

< (77 — 77^(77 — 77)) 

= (ff, ^V) - 2 (fj, A77) + (77, A77) 

< (77, A77) - 2 (77, At/) + (77, A77) 

= (t7,At7)-(7 ? ,At7), (3.36) 

so (77, A77) > (77, A77) and 77 is the minimizer of (77', A?/'). 

We still need to prove that the minimizer 77 is unique. This is done by showing that 1) (77, A77) is strictly 
convex in 77 and 2) the set ^(p, S) is convex-uniqueness will follow from convex programming theory. 1) 
It is trivial to show that (77, A77) is strictly convex in 77 since A > is a positive definite matrix. 2) We 
now show that the set ^ = ty(p,S) is convex. First, we see that for any rGP and corresponding x = 
(p — r) + G there exists x = p — f = (p — r) + = x with f G V. Let f k = min(p fc , r k ) < r k . Since f < r G V, 
then x G ^. Now, consider two vectors x, x' G ^ with corresponding r,r' £V such that x = (p — r) + and 
x' = (p — r') + . What remains to be shown is that for any a G [0, 1], ax + (1 — a)x' G Indeed, we have: 

ax + (1 — a)x' = ax + (1 — a)x' 

= a(p — f) + (l — a)(p — f') 

= p - (af + (1 - a)f') (3.37) 

By the convexity of V, we know that af + (1 — a)r' G V and subsequently, p — (af + (1 — a)f') G ^. This 
concludes the proof. ■ 
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Based on the characterization of r\ as the solution to the convex program (13.321 ). via convex optimization 
theory, we can conclude that there is only one fixed point. 

Lemma 3.lOThere exists exactly one fixed point, rj: 

rn 

< a m 

1 = 

m 

a m > => ( V , AS m ) > ( V , AS k ) , Vk (3.38) 

X ( t ) 

We have just shown that on all arrival traces with system load p, lim^oo —f 1 = % is unique. Furthermore, 
the limit, rj, is identical across all such traces, rj can be characterized as the unique solution to the convex 
program (13.91) : equivalently, it is the unique fixed point of our system. This concludes the proof of Theorem 
ED 

To summarize, whenever the system is in overload the workload grows along a vector defined by rj which 
is the solution of the convex program in Proposition l3.2l Moreover, r\ is independent of the particular arrival 
trace. From Lemma [3T8l we know that 7] is on the intersection of some set of cones. If there exists only one 
a m > 0, then rj = [p — S m ] + and is in C Sm - If there are multiple a m > 0, then rj = [p — J2 m Sm] + is on 
the boundary of the set of cones with a m > 0. We will utilize this information to control for our fairness 
criterion. 

4. Fair Control via the A matrix 

We have now seen how the asymptotic behavior of the workload vector, X(t), behaves given service vectors 
S and Max Weight matrix A. In particular, when the system load is outside of the stability region, the 
workload will explode along a single vector. During a long period of temporary stress, the queueing system 
is effectively unstable during this window and the valuable service resources become strained. Under the 
Max Weight scheduling policy, queues with exceptionally high load will starve resources from other, less 
stressed, queues. This begs the question of how to share resources in a fair manner when the system is 
unstable. Our goal in this section is to consider how to manipulate the A matrix in order to ensure 'fairness' 
in this queueing system. 

As we have discussed before, there are many different definitions of fairness. We focus on a notion of 
fairness where the workloads grow according to a fixed proportion. More formally, we assume we are given 
a set of ratios 9 q > 0, J2 q ®q = !• Whenever p <^V, the goal is to control the workload such that: 

lim X f] ' fl Vg eg (4.1) 
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From Theorem [XT] we know that lim^^ = r\ and we want: 



~%yq (4.2) 



When p S V, the system is stablizable, and so the workloads should remain finite. For large t: 



x q (t) 



0,Vg (4.3) 



We know that the MaxWeight scheduling policy guarantees the second criterion-it is a stabilizing policy 



(IRoss and Bambos 



20091) . The focus of this section is to show that the MaxWeight scheduling policy also 



satisfies the first criterion under certain conditions via proper specification of the A matrix. 
4.1. Control via the A matrix 

From Lemma |3.8[ we know that r\ is on the intersection of the set of cones with a m > in the definition 
of r\ = (p — Y2 m a raS m ) + ■ This corresponds is a cone boundary if there are more than one a m > 0. This 
boundary depends on the A matrix used in the MaxWeight scheduling policy. We now consider how we 
can choose the A matrix to place cone boundaries and, subsequently, achieve the desired fairness criterion. 

Lemma 4.1/n Q-dimensions, consider any M service vectors , S i2 , . . . , S iM . Suppose there exists a diag- 
onal positive definite matrix A and non-negative Q-dimensional vector v > such that v is a boundary 
vector of the M cones, i.e. for each k € [1, M ] and for all j: 

v,AS ih )>(y,ASj) (4.4) 

Then, for any non-negative vector rj such that rj q = if and only ifv q = 0, there exists a diagonal positive 
definite matrix A such that for each k £ [1, M] and all j: 

( V ,AS tk )>( V ,AS 3 ) (4.5) 

i.e. the boundary between the M cones can be placed arbitrarily in This matrix is specified as: 

( Km v > n- 

A « = 1 n (4 " 6) 

[1, v q = 0. 

This proof is given in the Appendix. 

Because Lemma |4~T1 holds for any positive definite diagonal matrix A, it will hold for A = I. Further- 
more, it is easy to verify condition (14.41) when A = I, as this results in taking simple inner products. 
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Corollary A.YThe boundary, rj > 0, between M cones defined by service vectors , S i2 , . . . , S iM can be 
placed arbitrarily in by using MaxWeight scheduling with matrix A if there exists v>0on the boundary 
of the M cones induced by A = I: 

<«,^)>(«,^),Vfee[l,M],Vi (4.7) 

Furthermore, v q =0 if and only if r\ q = 0. The required A is: 

"«>»•• (4.8) 

Under certain necessary and sufficient conditions we can arbitrarily place the cone boundary and we can 
then control the workload to explode along a desired vector defined by rj. 

Proposition AXThere exists MaxWeight matrix A such that 

X(t) 

lim — ±L = rj (4.9) 

t— >oo t 

if and only if the following conditions hold: 

1. T) = (p- Y; m ct m S m ) + for some a m > 0, XL » m = 1. 

2. There exists v > such that a m > implies (v, S m ) > (v, Sk) for all k. Furthermore, v q = if and 
only ifr] q = 0. 

This allows us to characterize the feasible fairness criterion: 

Corollary A.IFairness criterion 9 is feasible via MaxWeight Matching if and only if: 

1. There exist M service vectors and v > 0, with v q = 0if8 q = 0, such that 

(v,s. lk )>(v,s 3 ),yke[i,M],yj (4.io) 

2. For vectors S im in 1, there exist a m > 0, X*j =1 ct m = 1 swc/i that rj = (p — ^ m=1 a m 5' im ) + . Addi- 
tionally, for each a m > 0: 

(v,S m )>(v,S k ),Vk (4.11) 



3. ?y must satisfy: 



This is a direct consequence of Proposition [44] 



^ (4.12) 
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4.1.1. Feasible Criteria: An Example We now present an example with N = 2 service vectors and 
Q = 2 queues and specify the feasible criteria given p = [4, 4], Si = [1,2] and S 2 = [3, 1]. It is easy to see 
that v = [1, 2] satisfies Condition 1 in Corollary 14.21 as long as 9 > 0. Now, by Condition 2, 



T) = (p- aS 1 - (1 - a)S 2 ) + 
= a(p - Si) + (1 - a)(p - S 2 ) 



a 



+ (!-«) 



,Va€ [0,1] 



1/4 
3/4 



(4.13) 



[I -a) 



3/5 
2/5 



, a € 



To find the feasible 6, we normalize rj as in Condition 3. Hence, any 9 = a 
[0, 1] is feasible. In Figure 14.1.11 we can see the stability region and p, which is outside of the stability 
region. All fairness directions in the gray portion, such as 9, are feasible. Other fairness criteria, such as 9, 
are infeasible. 





(a)Stability Region (b)Feasible Fairness Criteria 

Figure 2 Feasible Fairness Criteria for p: N = 2 service vectors and Q = 2 queues. 



4.1.2. An Infeasible Feasible Criterion One might naturally ask whether the set of feasible fairness 
directions according to Max Weight Matching includes all feasible directions when a more general set of 
policies is allowed. It turns out the answer is no. We demonstrate this via an example where the fairness 
criterion is not achievable via Max Weight Matching but there exists a policy which does achieve it. Consider 
a scenario with Q = 3 queues and N = 3 service vectors: 




(4.14) 
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Let the fairness criteria and system load be: 

/l/3\ /l3/8\ 
e=\ 1/3 , P = 13/8 (4.15) 
\l/3/ V V2 / 

It is easy to see that using a combination of all three service vectors, the fairness criteria can be achieved: 



P — ~7>Sl — T So — — S'i 

4 4 2 







M 









(4.16) 



However, this fairness criteria cannot be met using Max Weight Matching. In particular, by Conditions 1 
and 2 of Corollary 14.21 there must exists some v > (since 8 > 0) such that: 

{v,S 1 ) = (v,S 2 ) = (v,S 3 ) (4.17) 

With some algebra, one can see that the v which satisfies (14.171 ) is 

(4.18) 

for any 7. Hence, there does not exists v > and Conditions 1 and 2 of Corollary 14.21 cannot be satisfied. 
This 8 is not feasible via MaxWeight Matching. 

We find that MaxWeight Matching allows us to control for a general, characterizable set of fairness crite- 
rion; however, there may be other policies which can achieve other criteria. Note that as long as MaxWeight 
policies can achieve the fairness criteria, it is guaranteed to achieve it in the most efficient manner by The- 
orem [4j] 




4.2. Workload Minimization 

Recall that our ultimate goal is to minimize the long run average backlog (12.181 ) subject to the fairness crite- 
rion (12. 171 ). So far we have established that, given a feasible fairness criterion 9, the MaxWeight scheduling 
policy will satisfy this criterion with the right choice of the matrix A. In particular, we have identified 
the 'direction' which the workload will grow as well as a methodology to control this direction. However, 
we have not specified the rate at which the workload will grow. We have used the MaxWeight scheduling 
policy to achieve our fairness criterion and justified the use of these algorithms because they are stabilizing 
when p&V, they are simple to implement, and they allow us to achieve our fairness criterion. We now dis- 
cuss another feature of the MaxWeight scheduling policy which makes it highly desirable for our purposes. 
Namely, it achieves the smallest workload which satisfies our fairness criterion. 



21 



Theorem A.XLet X(t) be the workload achieved under the MaxWeight scheduling policy. Let X(t) be the 
workload achieved under some other algorithm such that: 

X(t) X(t) 
lim — = T], lim — — = fj (4. 19) 

t— >oo t t—too t 

where both achieve the desired fairness criterion: 

Vq Vq 



e q y q (4.20) 



Then, rj is the minimal workload vector which can achieve the fairness criterion, 6: 

rj<fj (4.21) 

The proof of this Theorem is given in the Appendix. 

While there may be many algorithms which achieve our fairness criterion, 9, MaxWeight scheduling is 
efficient in the sense t hat no other algorithm ha s smaller backlogs. Note that our notion of efficiency is 



different than that from lShah and Wischik! (120111) . In their work, they show that MaxWeight is not efficient. 
However, they define efficiency as the total throughput of the system, i.e. they show that MaxWeight does 
not minimize J2 q X q (t) over all possible directions. This is quite different from what we show, which is 
that, given a direction 9, then ^ X q {t) is minimized. 

4.3. Robustness with Respect to p 

Thus far, we have assumed that the load vector p is known. Under this assumption, we are able to select the 
necessary MaxWeight matrix, A, to achieve the desired fairness criterion, 9, as long as it is feasible. Now 
we suppose that p is unknown and examine whether we are still able to choose A to achieve the desired 
fairness criterion. Throughout this discussion, we will assume that N > 1; otherwise there is no control and 
rj = (p — S) + for all p, irrespective of A. 

Consider the following example with N = 3 service vectors and Q = 2 queues as depicted in Figure |3] 
Let 

Si=(t),S 2 =( 3 ,),S 3 =(l) (4.22) 

Suppose our fairness criteria is: 



or V i / ' v 2 



We consider 3 different load vectors, which are outside of the stability region: 

*=(li)-»=(l)-*=(l)-»=(l) (4 24) 
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When the system load p = p 3 or p 4 , Conditions 2 and 3 in Corollary 14.21 cannot be satisfied; hence, the 
fairness direction, 9, is infeasible and there does not exist a MaxWeight matrix to achieve it. With some 
algebra, we can see that the necessary MaxWeight matrix to achieve the fairness criteria depends on p: 

^(1X^(1°.) (4-25) 



From Theorem |3.1[ the workload is given by r\ = [p — ^ m a m S m ] + . Hence, to achieve the desired fairness 
criteria, the goal is to find a point on the boundary of the stability region such that subtracting that point 
from the system load, p, results in a vector which is consistent with the fairness direction 9. From Figure 



3 (a) | we see that a point on the stability boundary which is given by the convex combination of Si and S 2 
satisfies this constraint for p 1 . The A matrix skews the dimensions such that the boundary of interest is 
placed in the direction of the desired fairness criterion and makes this distance 'minimal' as in Proposition 
13.21 Hence, the boundary vector of interest for p 1 is the boundary between cones 1 and 2. This boundary 
vector can be moved to the fairness direction 9 by using A^ Similarly, A 2 moves the boundary vector 
between cones 2 and 3 for p 2 . This example shows that the boundary vector of interest and, subsequently, 
the necessary MaxWeight matrix A depends on p. 

Despite the preceding example, it is possible to select A without precise knowledge of p. This ability 
depends on k, the number of subsets of service vectors {Si} of size greater than 1 which satisfy: 

(v, S tj > = (v, S ln )>(v,S m ), VSy , S in e {Si} and S m {SJ (4.26) 

for some v > 0, v ^ 0. Hence, v is a boundary vector as it is a vector on the boundary between neighboring 
cones {Si}. We refer to this boundary as a relevant boundary. Note that this boundary is potentially a 
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hyperplane of dimension greater than 1, so v may not be unique. Since N > 1, there exists at least one 
boundary which satisfies ( 14.261 ) (k > 1). Moreover, with N service vectors, there are 2 N — (N + 1) subsets 
of size greater than 1. Clearly, some subsets may not satisfy ( 14.261 ), so k < 2 N — (N + 1). Our two cases 
are: 

1. [k = 1] In this case, there is exactly one subset of service vectors with a relevant boundary. If the 
boundary of this subset is a hyperplane, then one can selected any boundary vector v > (with v q = if 
and only if 9 q = 0). Because there is only one boundary, we can specify the Max Weight Matrix, A, for any 
fairness criterion, 9. As long as the system load p is such that 9 satisfies Conditions 2 and 3 in Corollary 
14.21 this A matrix will control the backlogs to grow along 9. Therefore, we can choose A without knowing 
p. p simply determines whether a fairness direction 9 is achievable. 

2. [k > 1] In this case, there are multiple (but finite) subsets of service vectors which satisfy ( I4.26I ). For 
each subset, S(y) = {Si} (y £ [1, k]), let v(y) be a non-negative boundary vector with v(y) q = if an only 
if 9 q = 0. There is a A(y) such that A.(y) qq = v{y) q /9 q will place the boundary of the S{y) cones at the 
direction specified by 9. If 9 is feasible, there will be exactly one subset of service vectors S{y) for each p 
which satisfies Condition 2 of Corollary 14.21 There will be a range of p corresponding to each subset S(y), 
and subsequently A(y). As long as our estimate of p is within the accuracy of these ranges, we can select 
the appropriate A(y) to achieve the desired fairness criterion. 

In our example at the beginning of this subsection, there were 2 boundaries of interest: v i2 = [1,1] and 
v 23 = [1,2] (see Figure[3]). The boundary which matters depends on the system load, p, as well as the fairness 
direction, 9. For 9 = [2/3, 1/3], if p is in the lower region, R 12 , then the boundary vector of interest is v 12 , 
between cones C 1 and C 2 . If p G R 23 , then the boundary vector of interest is v 23 , between cones C 2 and C 3 . 
If p £ R\ of p € R 3 , the fairness direction is infeasible. These regions can be determined for each subset of 
service vectors by solving for the set of p which satisfy Condition 2 of Corollary 14.21 As long as we can 
determine which region p resides, the MaxWeight Matrix A can be specified without precise knowledge of 
P- 

See Section|5]for a numerical example of how the state evolution depends on A and p in these two cases. 
4.4. Other Fairness Criteria 

Thus far we have only considered fairness in terms of the ratios at which workloads will grow. As we have 
discussed, there are many different notions of fairness. In particular, proportional and max-min fairness are 
two widely used definitions of fairness. We now discuss how to extend our framework to these notions of 
fairness. 

Max-Min Fairness In Max-Min fairness, the objective is to maximize the minimum utility. If utility is 
a decreasing function of workload, this would correspond to minimizing the maximum workload. Because 
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our system is unstable, the workload in each queue will grow without bound. However, we know that the 
time-normalized workload has a finite limit so that: 

UmX{t)parft (4.27) 

t— >oo 

Therefore, to minimize the maximum workload, this would correspond to the objective: 

minmaxT/g (4.28) 

n q 

Hence, we can select 77 e ^{p, 5) which minimizes the maximum index to achieve Max-Min fairness. 

Proportional Fairness In the traditional sense of Proportional fairness, the amount of service resources a 
queue is allocated corresponds to the proportion of anticipated resource consumption required by the queue, 
p q . Hence, the fairness criterion would require that the average proportion of service rate to queue q, s q , is 
proportional to p q : 

- - Pq (4.29) 



q Efc Pk 

This implies that, loosely speaking, X q (t) = [X q (s) + p q (t — s) — s q S(t — s)] + , where S < ^2 q p q is the 
time-average aggregate service rate (if S > ^2 q p q then the system is stablizable). As t — > 00, this implies 
that 

l im ^M = K()q (4.30) 

for some constant K < 1. Hence, we can set r\ = Kp and achieve proportional fairness provided that 77 is a 
feasible fairness criterion. 

Generally speaking, we can achieve any notion of fairness which can be characterized by a vector rj which 
satisfies the constraints in Corollary 14.21 Note that unlike much of the conventional work on fairness, our 
framework presupposes that the queueing system is operating in an unstable regime. 

5. Numerical Results 

In this section, we present some numerical results to demonstrate the performance of MaxWeight Schedul- 
ing in a potential real system. We examine how the backlogs grow and approach the fairness criterion. All 
of our results are asymptotic results with t— >oo. We can see through some numerical simulations how large 
t must be in practice to approach our asymptotic results. 

To start we look at a system with two (Q = 2) queues and two (N = 2) service vectors given by the 
numerical examples in Section 1431 

Wi)-*-(?MtM$) 
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With only N = 2 service vectors, there is only one boundary vector; p is such that the fairness criterion 

1 0' 



is feasible (as in Corollary I4.2I ). so the Max Weight matrix A = A x = \ Z ^ J will achieve the fairness 
criterion. Our load vector p = [4, 1] T V. In each time slot, the number of jobs which arrive to queue 1 is 
uniformly distributed on [0,8]; for queue 2 it is uniformly distributed on [0,2]. In this case cti = 1/3, a 2 = 
2/3 so that rj = (p- a 1 S 1 - a 2 S 2 )+ = [2/3, 1/3] T . 

We consider how the workload vector grows for various initial conditions: 



X(0) 



,X(0) 



60 




,X(0) 
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(5.2) 



In Figure 4(a) we plot the trajectories of X(t) for the different initial conditions, along with the line X 1 = 
2X 2 . We can see that all three trajectories converge to the desired fairness vector Q x = 2/3, 6 2 = 1/3. In 
Figure |4(b)| we see the scaled backlogs, ^j^, and the relative backlog, Xi(t) / £\ X 3 {t), converge starting 
from initial condition X(0) = [0, 0]. Moreover, we see that they quickly achieve the fairness criterion which 
is shown in red. 



(a)Different initial conditions. 
Figure 4 Dyanmics for N — 2 service vectors and Q = 2 queues. 



(b)Initial condition X(0) = [0,0]. 



90 100 




70 80 90 100 



When there are N = 3 service vectors, there are k = 2 subsets of service vectors and corresponding 
boundary vectors which satisfy (I4.261 ). 




(5.3) 



Now there are two boundary vectors of interest: the one between C\ and C 2 as well as the one between 
C 2 and C 3 . The boundary which matters depends on p as described in Section l4~3l From that discussion, 
we know that A x and A 2 are the necessary Max Weight matrices to move the boundary vectors between 
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C\ and C 2 and between C 2 and C 3 , respectively, to fairness direction 6*. We refer to A(p) as the necessary 
MaxWeight Matrix to achieve fairness direction 0, given system load, p. Let p = p 1 = [4, 1] T ; we use Ai as 
before and we can achieve the desired fairness criterion. On the other hand, if p = p 2 = [3, 2] T , A. 1 will not 
achieve the desired fairness criterion, but matrix A 2 will. Hence: 



( J°),A( P2 ) = A 2 =(J° 



(5.4) 



We can see in Figure [5] how the asymptotic dynamics of the queues depend on p and A. The fairness 
criterion is shown in red. 
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Figure 5 Dynamics of 2-queue queueing system with 3 service vectors. 



In the next experiment, we consider a system with Q = 3 queues and N = 3 service vectors. Again there 
is only one v > boundary vector to consider. As long as the fairness direction 8 is feasible there is only 
one MaxWeight matrix A (to a scale factor) to achieve it. Feasibility depends on p. 




The desired fairness criterion is 
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With some algebra, it is easy to see that as long as the load vector p V is such that the fairness direction 
is feasible, then the necessary MaxWeight matrix, A, to achieve it is as follows: 

/2 0\ 

A= 3 (5.7) 
\0 6/ 

The system load oscillates between being stable and unstable. Hence, there are temporary periods of 
overload. 











Pstable — 





1 ; /^unstable 1 













(5.8) 



The system spends 500 time slots in the stable mode-p = p stab i e -then switches to spend 500 time slots in the 
unstable mode-p = /^unstable- Arrivals to queue q in each time slot are uniformly distributed between [0, 2p q ]. 
When the system is in the stable mode, MaxWeight Scheduling should stablize the workload. When it is in 
the unstable mode, MaxWeight Scheduling should achieve the desired fairness criterion. 

Figure [6] plots the scaled workload, ^p-, under this unstable/stable system. We can see that for the first 
unstable period (t G [0,500]), the fairness criterion is quickly achieved. However, on the next unstable 
period, the scaled backlogs (Xj (i) / 1) do not appear to stabilize within the 500 epoch period. This is because 
the workload has been stablized during the stable period and we are scaling by the total time, not just the 
time starting from when we enter the period of instability. Hence, it may actually take a very long time 
before the scaled backlogs converge. One the other hand, the fairness criteria is quickly achieved. The 

X (t) 

third subfigure shows how the backlogs grow relative to each other: ^ I: ' . We can see in this figure, the 
fairness criterion is achieved very quickly (plotted in red) during unstable periods. During stable periods 
this relative backlog is not very informative since all the backlogs will grow to zero. 

While our fairness results for controlling the backlog were asymptotic, these numerical results suggest 
that the fairness criterion can be achieved very rapidly. 

6. Discussion and Conclusion 

In many real world systems, traffic load is unpredictable and often bursty in nature. In any finite window of 
time, the system may enter a period of temporary instability where the rate of incoming jobs is larger than 
the rate at which jobs can be serviced. During such periods of stress, it is natural to want to allocate limited 
service resources across various jobs classes in a fair manner. 

In this work, we consider how to fairly serve under-provisioned queues. We focus on MaxWeight 
Scheduling policies because they are simple to implement and behave well during stable periods. In par- 
ticular, MaxWeight policies guarantee finite backlogs when the system load is within the stability region. 
We find that, whenever the system is overloaded, the backlog approaches a straight line as the time window 
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Figure 6 Dynamics of 3-queue queueing system oscillating between stable and unstable modes. 



during which the system is overloaded increases. This straight line can be characterized as a fixed point, or 
equivalently, as the solution to a simple convex program. As such, it is straightforward to identify this line, 
as a function of the system parameters, the load vector p, and the MaxWeight matrix A. 

Considering a fair allocation of resources in overloaded systems to be such that the backlog grows along 
a certain direction 6, we show how to choose the MaxWeight matrix A to guarantee that the backlog will 
indeed grow along this direction, as long as this direction is feasible. Additionally, MaxWeight is shown to 
asymptotically minimize the backlog, among all other policies that achieve the same fairness criterion. As 
it turns out the choice of A is robust with respect to the load vector p in the sense that for every direction 
9, there exists a partition of the instability region into subsets, such that the same matrix A will work for 
all load vectors in the same subset. In particular, it is sufficient to know what subset p belongs to, and it is 
unnecessary to know the exact value of p. Via numerical simulations we see that MaxWeight scheduling 
policy performs as expected; it achieves the fairness criterion during periods of overload and it stabilizes 
the queues otherwise. 

Our analysis relies on geometrical arguments that are applied directly to individual backlog traces. In 
particular, no probabilistic assumptions are made. The only necessary assumption is that the arriving work- 
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load has a well defined long run average. This approach is also helpful in developing intuition with respect 
to the system dynamics. 

This work can be extended in various directions. As demonstrated in Section l4.1.2[ there exist some fair- 
ness criteria that are infeasible via Max Weight Matching. So, one might consider whether other policies, 



such as Projective Cone Scheduling from 



Ross and Bambos 



(120091) . would expand the set of feasible fair- 



ness criteria. In a similar vein, one might want to obtain other fairness criteria for unstable systems. Third, 
it may be possible to exte nd this work to networks of parallel queueing systems, by relying on results from 



Shah and Wischikl (1201 II) . Finally, while we have established convergence of the backlog vector under vary 



mild traffic conditions, if more restrictive assumptions are made (such as Markovian queues) one might be 
able to obtain results on the rate of convergence as well. 

In this work we take a different view to traditional queueing. Namely, we focus on the instability region. 
While it is certainly desirable to operate systems within the stability region, there are many real world sce- 
narios where this may not be possible. Input traffic may surge due to unplanned circumstances. Service 
resources may be reduced due to unavoidable accidents or catastrophes. During these periods of temporary 
instability it is often necessary to allocate limited resources in a fair manner. Once the system exits the win- 
dow of stress, it will be stabilizable and the natural goals of throughput maximization and cost minimization 
can be restored. 
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Proof of Lemma 1372} 
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We write (using similar arguments like in equations of A.22 to A.27 of 



Ross and Bambosl(l2009l) ). 



'tc-l 



(X(t c ) - X(t' c ),A v ) = A ^> A v - E D <t)> A? 



\ t=t> c 

lt c -l 



\ t=t' c 

tc-l 



^2A(t),A v )-J2(D(t),^v) 



u=t' c 

ltc-1 



t=t' c 

tc-l 



E^M-E 



U=t' c 

lt c -l 



tc-l 



U=t' c 

'tc-l 



tc-l 



E D *® 

A qq T\ q + 

^■qqVq 

q:rj q >0 q--Vq=0 



S q (t)A qqVq + £ 5,(t)0 

q:ri q >0 q--Vq=0 



^2A(t),^n)-^{S(t),A V ) 



\ t=t' c 

ltc-l 



(Al) 



To see the above steps, recall the following. First, X(t) € V{rj) for every t € (t' c , t c ] and any c, by assump- 
tion. Therefore, X(t) S JC(rj), hence, from ( 13.151 ) we get D q (t) = S q (t) for q S Q with ?? ? > 0, for every 
t G t c ] and any c. Moreover, € C(r/) , hence, from ( 13.131 ) we get (S(t),Ar/) = max SeS (S, A77), 
for all tE(t' c , t c ] and any c. ■ 
Proof of Lemma [33} 

Note that t' n < t n eventually (for any large n), expand the terms as follows: 



t —f 

b n b n 



t —f 

b n b n 

and observe that letting n-s-oo we get 



t —f 

b n b n 



t —f 

b n b n 



t —f 

b n ti 



(A2) 



hm — — = p p ( 1) = p, 



\ 



(A3) 



since lim„ 



— p. This completes the proof of the lemma. 
Proof of Lemma l3~4l We write 

x(t m ) = £ m - E D ^ 



(A4) 



t=0 t=0 

and observe that D q (t) = mm{S q (t),X q (t)} < S q (t) for every q € Q, hence, —D q {t) > —S q (t). Therefore, 
since A is diagonal (with positive elements), we have — (D(t), A77) > (S(t),Arj) > — max SeS (S, A77). 
Projecting on Arj we get 

lt m -i \ 

(X(t m ),Arj)>( A (t)^ A V ) ~ max (S, A77) (t m ) (A5) 
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Dividing by t m and letting m— s>oo, we get 

(//, A77) > (p, A77) - max (5, A77) > (A6) 

This completes the proof of the lemma. ■ 
Proof of Lemma [331 Indeed (recalling that A is positive-definite), we have 

< (p - n, A(/i - v)) = (ft, A/i) - 2 (n, A77) + (77, A77) 

< (/i, A/i) - 2 (77, Ar?) + (77, Ar/) = (jt, A/j) - (77, Ar/) , (A7) 

so (/i,A/_r) > (77, Ar/). But since (r/, Ar/) = limsupt— s>oo (^^7^, A^^Y we must have (/j,A/i) = 
(r/, Ar/), therefore, (/i — r/, A(/j — r/)) = 0, which implies /i = r/. This completes the proof of the lemma. ■ 
PROOF OF Lemma [3T6l Rewrite the inequality as - [(/?, Ar/) - max SeS (S, Ar/)] e + (77, Ar/) > (1 — 
e) (r/, Ar/), since 1 — e > 0. This is equivalent (since e > 0) to 

(77, Ar/) > (p, Ar/) - max (5, Ar?) (A8) 

But this is true by Lemma [3~4l applied to the sequence {t c } with lim^^ x ^°' = rj. This complete the proof 
of the lemma. ■ 

PROOF OF Lemma[377} We have 2 cases to show since, by definition of {s c } we have that < < 1. 
The first case is A) e > and the second is B) e < 1. 

A) We first show that e > 0. We start by showing that there is no increasing unbounded subsequence {t b } 
of {t c \ such that lim^oo b ~ Sb = 0, where s b = max{i a < t b \. Note that this also implies that Hindoo ^ = 
1. Arguing by contradiction, suppose it exists. Observe that for every q £ Q we have 

- S q (t b - s b ) < X q (t b ) - X q (s b ) < A q (t b - 8b ), (A9) 

where A q < 00 is the m aximum workload that can arrive in queue q in any time slot (see model in 



Ross and Bambosl (12009b for assumption of boundedness) and S q = max SeS {S q } < 00 is the maximum 



workload that can be removed from queue q in any time slot. Dividing by t b , letting 6—^00, we get 

X(t b ) X(s b ) s b 



lim x( tt )-x W=o=1 . m 

6— >oc t]j b^-oo 



■ rj-ip (A10) 



t b s b t 

which implies that T] = ip and establishes the desired contradiction. 

B) We still need to show that e 7^ 1. Arguing by contradiction, suppose there exists a subsequence {U} 
of {t c } (and corresponding subsequence {s,} of {s c }) such that lim^^ t - L ^ L = 1, hence, lim^oo = 0. 
Applying Lemmas [3721 and [331 with {t ■} = {sj 

lim / - X(si) ^ A \ = _ ^ (An) 

i->oo \ i — s- / ses 
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It follows that 



(77, A77) = lim ( —,A.r] 



. X(tj) — X(Sj) U—S: X(Sj) Si 

lim ( — ^ ^ H ^ — , Arj 



2— »-00 



X{t t )-X{ Sl ) \ tl -s /X( Sl ) \si 

lim ( — — — < Ar y -^ + \^' A? y r 

= (p, At?) - max (S(t) , Arj) -l + (tp, At?) • 

SdzS 

= <p,Ar7>-max(5(t),AT;) (A12) 
Now applying Lemma |3~4l on the subsequence {sA with lim s x ^ = ib we get 

(■0, At?) > (p, A77) - max (5, At?) = (77, A77) , (A13) 

S (E$ 

using (|A12b . Hence, (ip, Arj) > (77, At/), which implies ip = r\ by Lemma [331 But this is impossible since 
by definition of subsequence {s c }, ip 7^ 77, which completes the proof of the lemma. ■ 
Proof of Lemma [378} Consider a subsequence {t n } such that for each m: 

a m = lim ^t=o Hs(t)=s m} (AU) 
n— >oo t n 

Note that by definition: a m € [0, 1] and J2 m a m < 1- Further, because p there exist (7 and T < 00, 
such that > for all t > T; hence, Max Weight Scheduling policies will never idle for t > T and 

We have for q such that ri 9 > 0: 

,. X q (t n ) 
rj q = lim — 

n->oo t n 



lhn Eto[A q (t)-D q (t)] 



lim 



^g(*o) + Et"t [AW ~ Em Sm,ql{S(t)=S m }] 



tn 

= Pg-/, cn m S m>q (A15) 

Where t Q < 00 such that for all i > rj , X(t) € V(t?). It's existence is given by Proposition 13. II For q such 
that rjg = 0, we have: 

= T7q = lim — - 

n— too t n 

= ^ E^q 1 [Mt)-D q (t)] 

n—>oo t n 

_ lim ^W) + E;:7 o 1 [A(0-E m min{X g (t),5 m ,Jl {s(t)=Sm} ] 
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> lim 



X q {t ) + Yj\ n =t [ A q( t ) ~ Em S m ^l {S{t)= s„ 



m 

Which means that p g — J2 m a mS m , q — and 

=T lq = [Pq ~ ^]a m 5 m ,,] + , 



(A16) 



(A17) 



which gives us that rj = [p - Y, m a mS m ) + . 

Finally, we have to show that if a m > 0, then 7? £ C Sm - We have seen that a m is the proportion of time 
that service vector S m is used under Max Weight Scheduling once X(t) E V(r]) for all t > t a . By Proposition 
13 - 1 L we know that t exists. By contradiction, suppose that r? Cs m . This implies that there exists m' 
such that (r],A.S m >) > (i),A5,„). Since ot m > 0, we must use S m for some t > t a . This contradicts the 
definition of V(rj), which by (13.131) says that MaxWeight Scheduling would use S m > rather than S m which 
would imply that a m = 0. Hence, if a m > 0, rj G C Sm - ■ 

PROOF OF Lemma [3T91 This follows from Lemma[331 Replacing rj = [p - Y^ m =i a mS m ] + we have 



I N + 
(r?, A??) = ([p-^2 a ™ S ™\ > A 



:riq>0 m=l 
N 

\p - ^2 amS " 



N 

\qVq+ Y) \p-^ j a m S m AggTJg 

; . L J q 



q-Vq^ 



m—1 

N 



q-Vq>0 



AqqVq + X] \ P ~ ^ a mS m 

q-.r/q—O m—1 



A w 



N 



^ a m S m , A? 



N 



(p, A??) - ^ {a m S m , At?) 

m—1 

(p, At?) - max (5, At?) 

o to 



(A18) 



where the last equality follows from the fact that ?? is a fixed point. ■ 
Proof of Lemma 13. lOt This result follows from the KKT conditions for optimality of the convex 
program ( 13.9D . Our goal is to show that if r? = (p — Y^ m ot m S m ) + is such that for all m with a m > 0, we 
have that (r?, AS m ) > (r?, A.S k ), then it is a solution to the convex program ( I3.9I ). The KKT conditions are 
necessa ry and sufficient for optimality i f the objective function is differentiable and Slater's constraint is 



satisfied 



Boyd and Vandenberghd (120041) . Our objective function is clearly differentiable. 



Slater's condition says that there exists r, a such that r < J2 m "m^m, r < p, a m > and J2 m a m = 1- It 
is clear that r = 0, a m = l/M satisfies this condition. Since the KKT conditions are necessary and sufficient 
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in this case and there is only one solution, it will follow that there is exactly one fixed point if all fixed points 
satisfy the KKT conditions. 

To examine the KKT conditions, we first rewrite the convex program in ( 13.91 ) as an equivalent convex 
program: 

min (p — r, A(p — r)) 
s.t. r <y^a m S m 

m 

r < p 

«m > 0, Vm 

X)om = l (A 19) 

m 

Let r*, a* n (and correspondingly rj* = p — r* = [p — a * m Sm] + ) be the solution to the preceding convex 
program. The KKT conditions for optimality say that all the constraints must be satisfied and: 

V (p - r,A(p - r)) + VA'(r - ^ a m S m ) + VA"(r - p) - VAa + Vv(J2 <* m - 1) = 

m m 

m 

^(r,-p,) = 



We look at the first condition: 



A,A',A'>>0 (A20) 

V rq : 2A qq (p-r*) q = \' q + y,Vq 

Y J (^P-r*) q A qq -K)(S m ) q = v-X m 

2(p-r*,AS m )=v + J2K- X ™ ( A21 ) 

Q 

Now we show that for any fixed point, there exists A, A', A", v which satisfy the KKT condition ( 1A20I ). To 
do this, suppose we are given a fixed point rj = p — r = (p — J2 m ®-m) + with 

a m > (p - r, AS m ) >{p-r, AS k ) (A22) 

We will construct non-negative Lagrange multiplies to satisfy the KKT conditions. 

Consider q such that p q > r q . In order to satisfy the third constraint in dA20| ), X q = 0. Now if p q < r q , in 
order to satisfy the first constraint in (IA2 lb we have that A^ + A'' = 0. To ensure that the Lagrange multipliers 
are non-negative, we must have that A^' = for all q. Subsequently: 

\' q = 2A qq (p-r) q ,\/q (A23) 
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Consider a m > 0. To satisfy the fourth constraint in (1A20I ). X, n = 0. Now to satisfy the second constraint in 
dA2Tb : 

< 2 (p - r, AS m ) = v, Vm such that a m > (A24) 

which also satisfies the non-negativity of v. Consider a m = and a k > 0. By the assumption that p — r is a 
fixed point: 

(p-r,AS m ) < (p-r,AS k ) 

v - X rn < v 

2 ~ 2 

=>- A m >0 (A25) 

Hence, we can satisfy the KKT conditions in (IA20I ) with non-negative \,\',\",v. Since any fixed point 
satisfies the necessary and sufficient KKT conditions, all fixed points are solutions to the convex program. 
There is only one solution and so there is only one fixed point. ■ 
Proof of Lemma I4.lt We show this via construction. Recall that A is diagonal: (v, As"j = 

Y. q V q^qq S q- FOT V q >0 

A^^ q (A26) 

Vq 

where the positivity comes from the fact that each element is positive. If v q = 0, 

A qq = 1 (A27) 

or some other arbitrary positive value. 

Now, for any ij (J £ [1, m]) and k the following holds: 



v,AS u ) > {v,AS k/ 

* J^AqqVqiS^qy^A^V^S^q 

9 9 

* Y v q A qq( S Oi ~ Y r li A ii( S ii)i ~ Y ^otO^a 
q q q 

^ Y V q A qq( S k)q ~ Y ^ll^ij )l~Y ^« A ««( 5 *) « 
9 9 9 

* Y^ Si ^1^11 V 1 ~ A ?? r ?<?) ~ ( S k)q A qqVq)} 
9 

> Y^ Sk ^^11 V 1 - A 1i r lq) ~ (^),A M »7 g )] 

9 

» (77, AS* ) > (r),AS k ) * (A28) 
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PROOF OF PROPOSlTlON l4.lt Assume that Conditions 1 and 2 are satisfied. We show this implies there 
exists a A such that lim^oo = r). We first consider Condition 2. This says that v > is the boundary of 
cones C m where a m > defined by A = I. By Lemma |4~T1 we can construct a A such that for all a m > 0: 

(r),AS m )>{r),AS k ) (A29) 

Now, in conjunction with Condition 1, we have that 7] £ ^(p,S) is a fixed point. By Theorem l3.ll we have 
that 

lim = v (A30) 

t— >oc t 

Now suppose there exists a A such that lim^oo = r\. By Theorem l3.ll r\ is a (the only) fixed point 
and, hence, satisfies Condition 1 . Now, we show that Condition 2 is satisfied by constructing the necessary 
v > 0. Similar to the construction of A in the proof of Lemma |4. 1 | we can determine v-the, boundary induced 
when A = I. That is: 

v q = A qq T] q (A31) 

which equals if and only if r\ q = 0. This v q satisfies Condition 2. ■ 
Proof of Theorem 14. It The proof is via contradiction. Since both Max Weight Scheduling and this 
alternative algorithm achieve the fairness criterion, there exists some k such that f) = ktj. Let's assume that 
■q is not the smallest scaled workload that achieves the fairness criterion so that k < 1. 
Since 

X(t) 

lim — >-L = kt) (A32) 

t->oo t 



for any e > 0, there exists T such that for all t>T: 

x q (t) 



KT) q 



< e (A33) 



X (t) 

For any q such that r\ q > 0, there exists some T q < oo such that for all t > T q , — ^ > and so after time 
T q , D q = S q (t), where D(t) and S(t) are the departures and service vector used in time slot t as defined in 
Section[2] Given e > 0, there exists T such that: 

< EL"o s q (k) EL 1 DM _ Ello 1 s q (k) Ello 1 r> q {k) ^ e (A34) 

Define a m > be defined as: 

a m = lim 1 (f(t)=B m} 

T->oo ± 

Note that ^ m a m < 1. a m is the proportion of time service vector S m is used up to time t. If the limit in 
(IA35I) does not exists, we can take a sub-limit which is well-defined since a m G [0, 1]. 
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We have for each q such that rj q > 0: 
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(A36) 



X (t) 

The second inequality comes from the fact that kt] is the limit of —f 1 . The third inequality comes from 



the definition of p as the long-term traffic load. The fourth inequality comes from (1A35I) . The last equality 
comes from (1A34I) . 

Let ip = (p - Y, a m S m ) + : 

(K77, A/C77) = [kt] + ip — ip, A(kT] + ip — ip)) 

= (kt] - ip, A(ktj -ip)) + 2 (kt) - ip, Aip) + (ip, Aip) 

> 2{kt]-iP,AiP) + (iP,Ai/j) 

> 2 {kt] - ip, Atp) + pq, Aip) 

= 2^ ( Kr )q ~ ■Pq)^-qq^q + 2 ~ ^q)^qq^q + (V, 

q:ij}>Q q:i/)=Q 

= 2 0A m V 9 + 2 ( KT lq ~ *Pq)^qqO + (V , ±V) 



q:ij)>Q 

(r;, At/) 



q:if>=0 



(kt), Akt)) > (r/, Arp) 

K>\ 



(A37) 



where the second inequality comes from Proposition l3.2l and the fourth equality comes from (IA36l ). We have 
a contradiction to the assumption that k < 1 ■ 



